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Abstract 

In realistic disordered systems, such as the Edwards- Anderson (EA) spin 
glass, no order parameter, such as the Parisi overlap distribution, can be 
both translation-invariant and non-self-averaging. The standard mean-field 
picture of the EA spin glass phase can therefore not be valid in any dimen- 
sion and at any temperature. Further analysis shows that, in general, when 
systems have many competing (pure) thermodynamic states, a single state 
which is a mixture of many of them (as in the standard mean-field picture) 
contains insufficient information to reveal the full thermodynamic structure. 
We propose a different approach, in which an appropriate thermodynamic 
description of such a system is instead based on a metastate, which is an en- 
semble of (possibly mixed) thermodynamic states. This approach, modelled 
on chaotic dynamical systems, is needed when chaotic size dependence (of fi- 
nite volume correlations) is present. Here replicas arise in a natural way, when 
a metastate is specified by its (meta) correlations. The metastate approach 
explains, connects, and unifies such concepts as replica symmetry breaking, 
chaotic size dependence and replica non-independence. Furthermore, it re- 
places the older idea of non-self-averaging as dependence on the bulk cou- 
plings with the concept of dependence on the state within the metastate at 
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fixed coupling realization. We use these ideas to classify possible metastates 

for the EA model, and discuss two scenarios introduced by us earlier — a 

nonstandard mean-field picture and a picture intermediate between that and 

the usual scaling/droplet picture. 
05.50.+q, 75.10.Nr, 75.50.Lk 
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I. INTRODUCTION 



The nature of the spin glass phase remains a fundamental and unsolved problem in both 
condensed matter physics and statistical mechanics despite over twenty years of intensive 
research. At a more basic level, the proper theoretical treatment of systems with quenched 
disorder and frustration remains open. Newer experiments exhibiting intriguing properties 
such as aging have not helped to resolve matters, but have instead intensified the ongoing 
debate [§. 

Spin glasses can be metallic or insulating, uniaxial or isotropic, mostly crystalline or 
completely amorphous; in general they are not confined to a single set of materials. The 
microscopic interactions which give rise to spin glass behavior may differ considerably from 
one material to another. (For a more extensive discussion, see the review article by Binder 
and Young 0.) Nevertheless, in 1975 Edwards and Anderson (EA) proposed a simple 
(and unifying) Hamiltonian to describe the thermodynamic, magnetic, and dynamical prop- 
erties of realistic spin glasses. Their basic assumption was that the essence of spin glass 
behavior arose from a competition between quenched ferromagnetic and antiferromagnetic 
interactions, randomly distributed throughout the system. 

While the EA model and its mean-field version, the Sherrington-Kirkpatrick (SK) model 
0, remain the primary focus of theoretical treatments of spin glasses, a number of other 
models have also been proposed [§. It is not our aim in this paper to compare the suitability 
of these models for the description of all, or some subset of, laboratory spin glasses. Here we 
are concerned instead with presenting the correct thermodynamic approach to understanding 
macroscopic properties of not only spin glasses, but more generally, systems which may 
have many competing pure states. Throughout this paper we will often apply our ideas and 
methods to the EA spin glass model — in particular, in its Ising form — but our scope is 
more general and is not confined to a particular model or a single condensed matter system. 
We will begin, however, by considering some of the very basic open questions which arise in 
connection with the EA Ising spin glass and related models. 
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These open problems cover both thermodynamic and dynamical questions. It is some- 
what discouraging that they persist at such a basic level. Very slow equilibration times 
make the analysis of both laboratory experiments and numerical simulations difficult; and 
techniques for the theoretical analysis of systems with quenched disorder and frustration 
remain primitive. So, for example, even though there has been a steady accumulation of 
evidence that there exists a true thermodynamic phase transition in the EA model (and in 
real spin glasses), it is fair to say that the issue is not yet closed (and from the standpoint 
of a mathematical proof, or even a convincing heuristic argument, remains wide open). If 
an equilibrium phase transition does exist, the lower critical dimension — and in particular, 
whether it is above or below three — is similarly unknown (see, for example, Refs. [|§-0)- 

Assuming the existence of a phase transition in some dimension, other open thermo- 
dynamic issues include the effect of a magnetic field on the transition; the number of pure 
states below the transition; the correct description of broken symmetry and the nature of the 
order parameter; critical properties at the transition; the role of quenched disorder and/or 
frustration, separately and together, in determining ground state structure and multiplicity 
I^QI; and the relationship between the properties of mean-field models and realistic spin 
glasses. These are only a subset of such very basic questions, which remain the subject of 
intense debate. 

Dynamical properties are central to spin glass physics — here, open problems include 
the origin of long relaxation times, the understanding of frequency-dependent susceptibility 
experiments, the origin and interpretation of aging, and the nature of metastable states. 
As before, this is only a small sample of outstanding questions. Tying together both the 
thermodynamic and dynamical problems is the general issue of the nature of broken ergod- 
icity (BE) in spin glasses |TO|-p!^j. BE may also serve as a bridge toward investigation of the 
relationships, if any, between spin glasses and other disordered systems - structural glasses, 
electric dipole glasses, quadrupolar glasses, and so on 0. 

Some thermodynamic questions are of direct experimental relevance: low-temperature 
properties cannot be understood without knowing the nature of low-energy excitations above 
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the ground state(s); a knowledge of the critical behavior is required before properties near 
Tc (if it exists) can be explained. It should also be emphasized that many (though not 
all) important dynamical questions cannot be properly understood, or in some cases even 
posed, without a correct thermodynamic theory of spin glasses. For example, what is the 
relationship, if any, between the metastable states of a spin glass and the pure thermody- 
namic states ||T3| , p!^ ? Moreover, many experiments, e.g. aging, have been explained using 



conflicting theoretical pictures |jT5|-§J]. In the absence of conclusive experimental (or even 
numerical) data deciding the matter, how does one decide among different theories of the 
spin glass state, much less explain the experimental observations? 

Our concern in this paper is therefore with the thermodynamic nature of spin glasses. 
In two recent papers p5|j26[l , we introduced several concepts that we believe are crucial 
for providing a correct and complete description of the equilibrium statistical mechanics of 
spin glasses and other disordered and/or inhomogeneous systems. Our approach, modelled 
on chaotic dynamical systems, is necessary in particular for understanding systems with 
competing thermodynamic states. The unifying idea is that of the metastate [^,^], which 



enables us to explain and relate chaotic size dependence |]2B|, replica symmetry breaking 
replica non-independence, and overlap (non-) self- averaging. 
Using the notion of the metastate, we have classified allowable thermodynamic "solu- 
tions" of the spin glass phase (some of which are new), and ruled out others, including one 
which has long dominated the theoretical literature. In this paper, we will expand and clar- 



ify the ideas presented in Refs. and ||26|, and use them to present a coherent approach 
to the thermodynamics of spin glasses and, more generally, to disordered and other systems 
with many competing states. We will begin by discussing a long-standing controversy over 
the thermodynamic nature of the spin glass phase. 

This controversy focuses on the multiplicity and ordering of pure states in realistic spin 
glasses in finite dimensions, at temperatures below some Tc > (which, supported by various 
arguments, is assumed to exist). One approach, which has dominated the spin glass literature 
for over a decade, assumes that the main features of Parisi's solution ||3O|-03i of the infinite- 



ranged SK model — an infinite number of pure states, organized by an ultrametric overlap 
structure |Q , and whose pairwise overlaps are non-self-averaging even in the thermodynamic 
limit — apply also to realistic spin glasses. In this scenario, the number of order 
parameters is infinite — i.e., the order parameter is a distribution that is a function of a 
continuous variable, and this distribution has a characteristic structure, both for a single 
realization of the couplings, and for the average over all such realizations. The nature of the 
symmetry breaking here differs from more conventional kinds, familiar from studies of various 
nondisordered systems: in Parisi's solution, the spin glass phase(s) exhibit spontaneously 
broken replica symmetry of a nontrivial kind. 

An alternative point of view arises from a scaling ansatz due to MacMillan |3^, Bray and 



Moore and Fisher and Huse p^^39|. This gave rise to a thermodynamic picture very 



different from that implied by the Parisi solution (although some features, such as chaotic 
dependence of correlation functions on temperature, are similar in the two pictures). In 



particular, the droplet analysis of Fisher and Huse [p8| , p9| led to the conclusion that there 
exists, at any temperature and in any finite dimension, at most a pair of pure states. (See, 
however, for a critique of this prediction.) Here the order parameter and the nature of 



symmetry breaking is markedly different from that of the Parisi picture. 

These two pictures reach opposite conclusions on a number of other thermodynamic 
issues; for example, any external magnetic field destroys the phase transition in the droplet 
picture, while that based on the Parisi solution displays an Almeida- Thouless line . (For 
discussions on whether numerical evidence supports such a transition, see Refs. ||4^j43[] .) 



Both pictures also imply certain dynamical behavior for spin glasses. However, although 
the physical origins behind various dynamical mechanisms differ markedly in the two pic- 
tures, their observable consequences are often similar (see, for example, the experimental 
and theoretical discussions on aging in Refs. |I5|-|2^), and most experiments have so far been 



unable to distinguish between the two pictures. (One possible exception, however, is the 
set of experiments on noise in mesoscopic spin glass samples by Weissman and collaborators 



In addition to these pictures, there also exist scahng approaches which predict many pure 
state pairs at low temperature above three dimensions [Q. A number of other speculative 
pictures of the spin glass state have also appeared (see for a more thorough presentation), 
but it is probably fair to say that the scaling/droplet and Parisi pictures presented above 
have dominated the discussion of the nature of the spin glass phase(s). 

The droplet picture of Fisher and Huse makes a number of clear predictions, and is 
relatively easy to interpret for realistic spin glasses. This has not generally been the case 
for the Parisi ansatz, and indeed an important issue — although not always recognized as 
such — is to interpret the implications of the Parisi solution, both thermodynamically and 
dynamically, for the spin glass phase in finite dimensions. A large literature (see below) 
exists on the subject, and as a result a reasonably clear consensus has emerged on the 
thermodynamic structure of short-ranged spin glasses given that the Parisi ansatz holds for 



them also. We have called this the "standard SK picture" in and [^, and will use that 
terminology also throughout this paper. 

The main result of [^] was to prove, however, that the standard SK picture cannot apply 
to realistic spin glasses in any dimension and at any temperature. This result then led in 



PB| to an observation which is central to understanding any system with many competing 



thermodynamic states: one should not focus on any particular (mixed) thermodynamic 
state, which cannot provide sufficient information to describe the thermodynamic structure; 
instead, one must consider the metastate, which is essentially a probability distribution over 
the thermodynamic states. One important consequence of and p6[ is to redefine the 
meaning of non-self-averaging, and to show that most quantities of interest can be defined 
for a single realization of the disorder (including those which had been thought to be non- 
self-averaging in the thermodynamic limit). One can then focus on, and make meaningful 
statements about, a particular sample rather than an ensemble of samples. This feature 
should hold also for nondisordered (e.g., inhomogeneous) systems in general. 

Using the metastate approach, we were able to narrow down the possible thermodynamic 
structures for realistic spin glasses. One of these is the scaling/ droplet picture; some are 



new. Finally, we proposed a possible picture which incorporates some of the features of the 
Parisi solution for the SK model. In fact, this is the "maximal" mean-field picture allowable 
for realistic spin glasses, but it differs considerably from the familiar standard SK picture 
presented in the literature. We call this new scenario the "nonstandard SK picture" and 
will discuss it in Section |V11[. One important lesson from our analysis is that, for disordered 



systems, the features which characterize the system in very large but finite volumes may lead 
to a misleading thermodynamic picture if straightforwardly extrapolated to infinite volumes. 
This is of potential importance, for example, in interpreting numerical results. There are 
previously unsuspected intricacies involved in taking the thermodynamic limit for certain 
disordered systems. 

The plan of the paper is as follows. In Section H we review some basic features of the EA 
model and discuss its finite- and infinite-volume Gibbs states. We discuss the problem of 
whether many pure states may exist at some dimension and temperature, and show that the 
answer is independent of coupling realization. In Section ^ we introduce the SK model and 
the Parisi ansatz for its thermodynamic structure. In Section |rV| we discuss the standard 
mean-field picture for realistic spin glass models in finite dimension. We then show that this 
picture cannot hold in any dimension and at any temperature. We also provide an explicit 
construction of a non-self-averaged thermodynamic state whose overlap distribution function 
must be self-averaged. In Section we describe a new approach to the thermodynamics of 
systems with many competing states, based on the idea of the metastate, an ensemble of 
thermodynamic states. We also present some of the possible scenarios for the metastate of 
the EA model, including one that is intermediate between the scaling/droplet and mean- 
field pictures. In Section ^ we show how replicas arise naturally within this approach, and 
how the older idea of replica symmetry breaking is understood and unified with newer ideas 
of dispersal of the metastate and replica non-independence. A replacement for the usual 
definition of non-self-averaging is also presented. In Section |VI1| we introduce the maximal 
mean-field picture allowable for realistic spin glasses, and show that its thermodynamic 
features are considerably different from those of the more familiar picture (which cannot 
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hold). Finally, in Section |VII]| , we summarize our main results and discuss their implications 
for the study of spin glasses and, in a larger framework, systems with many competing states 
in general. 



II. THE EDWARDS- ANDERSON MODEL 

The Edwards-Anderson (EA) model on a cubic lattice in d dimensions is described 
by the Hamiltonian 

where J denotes the set of couplings Jxy and where the brackets indicate that the sum is over 
nearest-neighbor pairs only, with the sites x, ?/ G Z'^. We will take the spins (j^ to be Ising, 
i.e., = ±1; although this will affect the details of our discussion, it is unimportant for 
our main conclusions. The couplings J^y are quenched, independent, identically distributed 
random variables; throughout the paper we will assume their common distribution to be 
symmetric about zero (and usually with the variance fixed to be one). The most common 
examples are the Gaussian and it J distributions. 

Eq. (|l|) is the EA Ising Hamiltonian for an infinite- volume spin glass on Z"^; it is important 
also to define the EA model on a finite volume, given specified boundary conditions. Let 
Ai be a cube of side 2L + 1 centered at the origin; i.e., A^^ = {— L, —L + 1, ■ ■ ■ , L^. The 
finite- volume EA Hamiltonian is then just that of Eq. confined to the volume A^, with 
the spins on the boundary dh^L of the cube obeying the specified boundary condition. (The 
boundary dKi of the volume A^^ consists of all sites not in A^ with one nearest neighbor 
belonging to K^.) For example, the Hamiltonian with free boundary conditions is simply 

=- Jxy(Tx(yy ■ (2) 

{x,y)&l^L 

Another important boundary condition, called a fixed b.c, is where the value of each spin 
on the boundary is specified. If we denote by a the specified boundary spins, then the 
Hamiltonian becomes 
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We will frequently employ a familiar and commonly used boundary condition, namely 
periodic boundary conditions, where each face of the cube A^, is identified with its opposite 
face. These are generally thought of as minimizing the effects of the boundary (but see van 
Enter [0), and allow us to construct manifestly translation-covariant states. 

Given the EA Hamiltonian Tij^i on a finite volume A^, with a specified boundary con- 
dition (e.g., free or fixed or periodic, but without the boundary condition superscript here), 
we can now define the finite- volume Gibbs distribution p^|j on Aj;, at inverse temperature 
(3: 

p%ia) = Z-^^exp{-(3nj,M} , (4) 

where the partition function Zl^^ is such that the sum of p^ jj over all spin configurations in 
Al yields one. In addition to the boundary conditions mentioned so far, one also considers 
so-called mixed boundary conditions where the Gibbs distribution is a convex combination 
of the fixed boundary condition distributions for a given L with the weights for the different 
a's adding up to one. 

p'j]p{(y) is a finite- volume probability measure, describing at fixed (3 the likelihood of ap- 
pearance, within the volume A^, of a given spin configuration obeying the specified boundary 
condition. Equivalently, the measure is specified by the set of all correlation functions within 
Ai, i.e., by the set of all {a^i ■ ■ ■ c^m) for arbitrary m and arbitrary xi, . . . , Xm G A^. 

Thermodynamic states are described by infinite-volume Gibbs measures, and therefore 
can be thought of (and indeed, constructed) as a limiting measure of a sequence, as L — > cxd, 
of such finite-volume measures (each with a specified boundary condition, which may remain 
the same or may change with L) . The idea of a limiting measure can be made precise 
by requiring that every m-spin correlation function, for m = 1,2, . . ., possesses a limit as 
L — s> oo. 

It is clear that, if there is more than one thermodynamic state (at a given temperature) 
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and if arbitrary boundary conditions are allowed for each L, different sequences (of volumes 
and/or boundary conditions) can have different limiting measures. What is less obvious, 
but will have important consequences for spin glasses, is that if many thermodynamic states 
exist, a sequence of measures each having the same (e.g., periodic or free) boundary condition 



will be more fully described in Section 0. Because of compactness (i.e., because each of 
the correlations determining the measure takes values in [—1, 1], a bounded closed interval), 
it follows, however, that every such infinite sequence will have some subsequence(s) with a 
single limit, so that we are guaranteed the existence of at least one thermodynamic state 
(i.e., infinite- volume Gibbs distribution). At sufficiently high temperatures it is rigorously 
known (see below) that there exists only one such state (limiting Gibbs measure), which of 
course is the paramagnetic state. If the spin-flip symmetry present in the EA Hamiltonian 
Eq. (|l|) is spontaneously broken above some dimension do and below some temperature 
Tc{d), there will be at least a pair of limiting measures, such that their even-spin correlation 
functions will be identical, and their odd-spin correlation functions will have the opposite 
sign. Assuming that such broken spin- flip symmetry indeed exists for d> and T < Tc{d), 
the question of whether there exists more than one such limiting pair (of spin-flip related 
infinite-volume Gibbs distributions) is a central unresolved issue for the EA and related 
models. 

Thermodynamic states may or may not be mixtures of other states. If a Gibbs state 
p j^p can be decomposed according to 



where < A < 1 and and p^ are also infinite- volume Gibbs states (distinct from p), 
then we say that pj^p is a mixed thermodynamic state or simply, mixed state. (A mixed 
state may, of course, have many, perhaps infinitely many, states in its decomposition.) The 



may not even have a limit This phenomenon, which we call chaotic size dependence, 




(5) 



meaning of Eq. (^ can be understood as follows: any correlation function computed using 



the Gibbs distribution pj^p can be decomposed in the following way: 
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(cTxi ■ ■ ■cr:,„)p_y^3 = A(cr^, ■ ■ + (1 - A)(o-^., ■ ■ ■cr^„)p^^^ . (6) 

If a state cannot be written as a convex combination of any other infinite-volume Gibbs 
states, it is called a pure (or extremal) state. As an illustration, the paramagnetic state 
is a pure state, as are each of the positive and negative magnetization states in the Ising 
ferromagnet. In that same system, the Gibbs state produced by a sequence of increasing 
volumes, at T < Tc, using only periodic or free boundary conditions is a mixed state, 
decomposable into the positive and negative magnetization states, with A = 1/2. A pure 
state pp can be intrinsically characterized by a clustering property (see, e.g., |]47|j48[| ), which 
implies that for any fixed x, 

{(yx(yy)pp- {(7x)pp{(yy)pp o, \y\^oo , (7) 

and similar clustering for higher order correlations. 

Let 7]{J',d,l3) now denote the number of pure states in the EA model for a specific 
coupling realization J'. For any d and J' this equals one at sufficiently low (3 (except for a 
set of jT's with zero probability according to the underlying disorder distribution — see, e.g.. 
Chapter 3 of [0] and the references cited there). Recall that the droplet picture predicts 
that ?7(i7, d, P) < 2 for all d and /?, while the SK picture assumes that ri{J', d, P) = oo for d 
above some (unknown) d^ and (3 > I3c{d). 

A reasonable question might then be, could the answer (at fixed (3 and d) depend on Jl 
What if ?7 = 2 for half the coupling realizations (i.e., for a set of coupling realizations with 
probability 1/2), and infinity for the other half? As it turns out, this cannot happen: for a 
fixed coupling distribution, rj at some {d,(3) must have the same value for all instances J 
chosen from the disorder distribution (or more precisely, for almost every J — i.e., except 
for a set with probability zero). In other words, r]{J',d,j3) is self- averaged; for fixed d and 
(3, it is a constant almost surely as a function of JT". 

The above statement is mathematically rigorous, but since its proof, and that of all 
other theorems which appear in this paper, have appeared elsewhere (see, e.g., PD| , |5D| ), we 



here recount only the central arguments. (These arguments will be useful later when we 
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discuss possible scenarios for the thermodynamic structure of the spin glass phase in the EA 
model.) We first note that //(JT", d, (3) is clearly translation-invariant; i.e., if all couplings are 
translated by any lattice vector a, so that each J ^ J"^ (i.e., Jxy —>■ Jx+a,y+a), the function 
is unchanged: rj{J,d,(3) = ri{J'"-,d, (3). We next note that the disorder distribution //(JT") 
(e.g., an independent Gaussian distribution of mean zero and variance one at each bond 
on the lattice) is both translation-invariant (trivially) and translation- erg odic. Translation- 
ergodicity means that for //-almost every J', the (spatial) average of translates f{J^"') of any 
(measurable) function f on J equals the i/-average of /. (As a trivial example, consider a 
\d problem where the function f{J) is just the coupling value Jqi at a given location on 
the line. The average of f{J'^) along the line is clearly 0; so is the distribution average 
at any site. Similarly, for the function f{J) = (Jqi)'', the spatial average along the line 
equals the distribution average at a site, i.e., the kth moment of the random variable Jqi.) 
That translation-ergodicity in several dimensions holds analogously to the more familiar 
one-dimensional case seems to have first been shown by Wiener . 

The assumption that / be measurable is a necessary, but somewhat technical require- 
ment. A proof that ri{J',d,P) satisfies the necessary measurability properties appears in 
P5| , |5D[] , and will not be discussed further here, except to note that measurability of a func- 
tion / is the minimal requirement for having a well defined meaning for the average of / 
over the disorder distribution u. 

Returning to the main argument, we note that because T]{J',d,(3) is a translation- 
invariant function of random variables whose distribution is translation-ergodic, by av- 
eraging ri{J'°',d,P) = ri{J',d,P) over translates, it follows that ri{J',d,P) equals a con- 
stant ri{d, P) almost surely (i.e., for almost every J'). ri{d, P) is the distribution average of 
ri{J',d,l3) and it could of course depend on the distribution from which the couplings are 
chosen, but not on any specific realization chosen from a fixed distribution. 

The same line of reasoning used here to show that the number of pure states at fixed d 
and (3 is the same for almost every realization J' was used in [EH] to rule out the standard 



SK picture. This will be discussed later in Section |3 but first we present a discussion of 
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the infinite-ranged SK model and the Parisi solution. 



III. MEAN-FIELD THEORY AND THE PARISI SOLUTION 

The Sherrington-Kirkpatrick (SK) model has played an important role in spin glass 
physics for several reasons. First among these is that it is one of the few (nontrivial) spin 
glass models which is (generally) believed to have been solved. Moreover, the proposed 
solution, due to Parisi admits a striking type of symmetry breaking, called replica 

symmetry breaking (RSB), of a form previously unseen in other (nondisordered) systems. 
The possibility that RSB plays an important role in the physics of realistic (i.e., finite 
dimensional) spin glasses and, possibly, other complex systems has generated a substantial 
literature (see, for example, Refs. ) and remains controversial. 

The SK model is simply the infinite-ranged version of the EA model and thus has no 
spatial structure. The volume L'^ is replaced by A^, the number of spins, and the Hamiltonian 
is 

1 ^ 

'^j.N{<y) = --7^ ^ Jij<yi<yj , (8) 

^ i>j=l 

where the factor 1/\/N ensures that the energy per spin remains finite (and nonzero) as 
N oo (given that, as before, the distribution of each Jij is symmetric about zero and 
has variance one). Because there is no natural sense of a boundary in this model, one 
usually considers simply a sequence of Hamiltonians of the form (^ with increasing A^. The 
probability measure on spin configurations in this model is given by 

p^^l{a) = Z-^'pe^Y>{-mjA^)} ■ (9) 



It has been known for many years |^ that a correct treatment of quenched disorder 
involves an averaging (over the couplings) of the free energy and other extensive variables 



rather than of the partition function. The replica trick ||3| j63|j6^ was introduced as a tool for 



doing such an average; because of the lack of spatial structure in the SK model, it is especially 
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well suited for this approach. Using the replica trick, SK demonstrated the existence of a 
phase transition, but found that the resulting low-temperature phase was unphysical . It is 
currently believed that their solution was unstable because it was replica-symmetric. Several 



attempts were made to introduce solutions which broke the replica symmetry ||6^, but it is 
now thought that the correct procedure to break replica symmetry in the low-temperature 
phase of the SK model was the one introduced by Parisi . 

The Parisi solution to the SK model is both stable and agrees well with numerical 
results moreover, some of its essential features can be rederived without the use of 



replicas, primarily through a cavity method [|66| , |67| . Parisi's approach suggests that there 



are many pure states of the infinite-ranged model, organized in a highly specific manner 
which characterizes the SK spin glass phase and its mode of symmetry breaking. Although 
Parisi's solution predicts many other important features of the spin glass phase P,p9 



we 



will focus here only on its aspects regarding symmetry breaking and order parameters. 

We first need to comment on what is meant by "pure state" in the SK model, since a 
precise definition is not available and its meaning remains quite unclear. Other approaches 
to spin glass mean- field theory (e.g., the TAP equations [^) had already suggested the 



existence of many states at low temperature, in the sense that many solutions could be found 
which were extrema of the free energy, some subset of which were believed to be minima 
||69|| . It had further been argued that they were separated by barriers which diverged in 
the thermodynamic limit [^,^. These are what have come to be called p9| the "pure 



states" of the SK model. The clustering property described by Eq. cannot be used in an 
infinite-ranged model, which has no spatial structure, but it has been suggested P,p9| that 
it can be replaced by 

\iva. {aiaj)p^N - {(^i)l3,N{(yj)p,N =0, {i ^ j) , (10) 

where averages are taken using the distribution corresponding to one of these pure states. 
The meaning of the averaging in Eq. (|r^) is poorly defined, however. Because the strength 
of the random couplings scales to zero as ^ oo, it is unclear what meaning, if any, can 
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be ascribed to the notion of nontrivial thermodynamic states, pure or mixed. In the EA 
model, on the other hand, methods do exist, as will be briefly discussed in the next section, 
to construct just such states, for almost every J . This contrast between the SK and EA 
models will be seen to be significant. 

However, in accordance with the usual practice, we will ignore these complications in 
what follows, though keeping in mind that the meaning of pure state in the SK context 
remains vague. Using a replica analysis, Parisi found that the SK spin glass state could be 
described properly only with an infinite number of order parameters, describing the relations 
among the many pure states. This requires the introduction of a new random variable which 
describes the replica overlap, 

1 ^ 

Qn = J^J^'^^^'i ^ (11) 

1=1 

where the spin configurations a and a' are chosen independently from the distribution 
p^jpicr) given by Eq. (^. (Technically, a and a' are said to be chosen from the product 
distribution p^j^^{cr)p^j^^{cr')). It is clear that —1 < Qn < 1 for any A^. (The subscript P 
will be suppressed in expressions related to replica overlaps and their distributions. It is 
understood that all calculations take place at fixed /3, and the results depend on /?.) 

The role of order parameter in the Parisi theory is played not by a single variable, but 
rather by the probability density Pj,n{<1) of the random variable (or functions closely 
related to it); i.e., Pj^N^q) dq is the probabihty that the random variable Qjy takes on a value 
between q and q + dq (for fixed J', N and (3). Above the critical temperature (i.e., in the 
paramagnetic state), the distribution of Qjy converges to a delta-function at zero as A^ — > cxd. 
Below this temperature, however, the presumed existence of many states gives rise to a rich 
and nontrivial behavior of Pj,N{q)- In particular, Parisi found that in the spin glass phase, 
Pj ]^{q) approximates a sum of many delta-functions, with weights and locations depending 
on J even in the limit N —>■ oo. This is the first appearance of non-self-averaging (NSA), 
which plays a central role in the Parisi theory of the spin glass phase. 

The usual explanation given for this behavior is that for large A^ the Gibbs measure pj^^ 
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given by Eq. (|^) (for /3 > /3c) has a decomposition into many pure states p°j^ where a indexes 
the pure states: 

py)(a)^5^iy>^(a), (12) 

a 

where Wj denotes the weight of pure state a and the dependence on the inverse temperature 
/3 has been suppressed. (The use of the approximation sign is necessary because of the 
haziness of the meaning of pure state, as discussed above.) Granted the existence of these 
pure states, one can then consider the case where a is drawn from the distribution p'j and 
o' independently from p'j] then the expression in Eq. ( pT]) equals its thermal mean, 

1 ^ 

^7^^Y.^<yr^o,y . (13) 

i=\ 

Finally, the density Pj,n{<i) is then given by 

PjA<i)^Y.^jW}Kq-q7) ■ (i4) 

a, 7 

These expressions can be made precise for the EA model, as will be seen in the next section. 

The q^^^ also exhibit NSA for arbitrarily large A^, except for the trivial cases = 7 and 
a = —7 (where the minus sign denotes a global spin flip), which correspond respectively to 
the self-overlaps qea and —Qea (with no dependence on JT" or a). Why don't we then simply 
examine the N —>■ 00 limit of the q'j'^s and their distribution? A priori it might seem that, 
even though the states themselves are not well-defined for infinite A^, their overlaps might 
still have a well-defined limit. It can be proved, however, that the existence of the N ^ 00 
limit (where the limit is taken in a J' -independent manner) of the distribution of the qj 's 
is inconsistent with NSA This is the first appearance of chaotic size dependence, which 
will be seen later to play a central role in the analysis of systems with many competing 
states. 

Even though the decomposition of Eq. (p!2| ) is presumed to consist of infinitely many 
states as A^ ^ 00, it is believed that relatively few of them have non-negligible weight 



(and are therefore thermodynamically significant). These lowest-lying states are believed 
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to have free energy differences of order one (for arbitrarily large N), and their density rises 
exponentially |6^J6^ at the lowest energies. 

So far we have only discussed the overlaps among pairs of pure states. The relationships 
among triples of pure states were also investigated , and were found to have an ultrametric 
structure. That is, the Hamming distances (determined by the overlaps) among any three 
pure states are such that the largest two are always equal (with the third smaller than or 
equal to the other two). 

The main features of the Parisi analysis of the SK model, relevant to the ordering of the 
spin glass phase, are then the following: 

1) The spin glass phase consists of a mixture of infinitely many pure states. Two replicas 
have non-negligible probability of appearing in different pure states (not related by a trivial 
global spin flip). This is one interpretation of spontaneous replica symmetry breaking (RSB). 

2) For fixed J', the probability density Pj{q) consists of a sum of (approximate) delta- 
functions at discrete locations q such that —Qea < q < qEA, and a pair always at ±qEA- 
The weights and locations of the delta-functions, excluding the pair at ±qEA, depend on J', 
even as oo (NSA). 

3) Because of this variation with J' of the "interior" delta-functions, the average P{q) = 
Pj{q) over all (uncountably many) coupling realizations has a continuous (and nonzero) 
component for q between the delta-functions at ±qEA, for < T < Tg. 

4) The locations of the delta-functions in 2) have an ultrametric structure. 

In the next section, we examine the meaning of the Parisi picture applied to the EA 
model. 



IV. THE STANDARD SK PICTURE 



If the Parisi solution of the SK model describes the nature of the spin glass phase in 
reahstic spin glasses, as frequently supposed P JT^JT^J53|J5^ - p5| , p7| -[HT|] , what should be its 
thermodynamic properties? A description along these lines has emerged in the literature 
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see, for example, Refs. p9| , |55| , ^|6T| , [72| ) over the past decade and a half. This scenario. 



which we have called the "standard SK picture" ||2^, is the most straightforward extrap- 
olation of the main features of the Parisi solution to infinite volume spin glasses in finite 
dimension and is presented in this section as a precise description of the usual presentations 
in the literature (see, for example, Refs. P J2P|JI^J7^ ) . 



As discussed in Section the meaning of pure states in the EA model (and other realistic 
models) is clear — they are extremal infinite volume Gibbs states (i.e., thermodynamic states 
which cannot be decomposed as in Eq. (^; equivalently, they satisfy the clustering property 
as in Eq. (|^)). It is natural then to replace the approximate relation Eq. (|12D with an 
equality 



PJ 



where pj{cr) is an infinite volume mixed Gibbs state (at fixed temperature) for a particular 
coupling realization J', and the pj are pure states for that J'. There may be many such 
mixed states, so we specify the one above as that produced in some natural way (to be 
specified later) by a sequence as L ^ oo of finite volume Gibbs distributions on cubes 
Al with boundary conditions, such as periodic, not depending on the coupling realization. 
Periodic boundary conditions minimize, in some sense, the effect of a boundary and are thus 
a natural analogue to the lack of boundary conditions in the SK model. It should be noted 
however that there is some possibility of different behavior for periodic as opposed to, say, 
free boundary conditions ||4^ . 



We digress momentarily to discuss briefly two important points. The flrst is that, while 
the notion of an inflnite volume (pure or mixed) state is well deflned for nearest neighbor 
models, it is less so for systems with very long-ranged interactions, such as RKKY. Our 
arguments that are based on the homogeneity of the disorder, presented below, will still 
apply to these systems, but this point should be kept in mind. 

The second point is that it is necessary that pj, obtained from the natural limit procedure 
discussed above, be deflned for almost every J' chosen from the disorder distribution u (and 
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be measurable in its dependence on — see Section H). While this may seem like a technical 
point of little physical consequence, it actually plays a crucial role in any thermodynamic 
treatment of systems with many competing states p5| , p6| , p8| . We will come back to this 
point in a little while. 

Returning to the standard SK picture, we note that the other equations in Section |IT| are 
similarly replaced with their exact EA counterparts. The overlap random variable becomes 



Q = hm lA^r^ V (16) 



where a and a' are chosen, similarly to before, from the product distribution pj{<y)pj{o'') 
If a is drawn from pj and a' from p'j, then it follows that the overlap is the constant 



g7= hm lA^I-i • (17) 



The probability distribution Pj{q) of Q is therefore given by 

Pj{q) = Y.^jW}6{q-qJ') . (18) 

a, 7 

So this SK picture for the EA model (or realistic spin glasses in general) includes the same 
four features presented at the end of the previous section (except the word "approximate" 
in the second of these should be deleted); their meanings are now precise. There are other 
elements of the standard SK picture — e.g., energy gaps of order one separating the lowest- 
lying states in any large volume and an exponentially increasing density at the lowest energies 
— but these will not play a central role in what follows. 

We turn now to the question of whether the standard SK picture can be valid in any 
dimension or at any temperature. This question has two parts. 

First, does there exist some natural construction which begins with the finite volume 
Gibbs states p^j^i^{a) of Eq. (|), takes L ^ oo, and ends with a (non-self- averaged) infinite 
volume state, pj^p (possibly mixed), and its accompanying overlap distribution Pj{q)7 By 
"natural" we mean not only the usual sense of the term but also that the construction result 
in a thermodynamic state p j for almost every J'. In particular, we want the limit procedure 
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(e.g., choice of boundary conditions or sequence of cube sizes) to be chosen independently of 
any specific J . This will help guarantee that the jT-dependence generated by this procedure 
is measurable, and therefore that averages (e.g., of the moments of Q) can be taken with 
respect to the disorder distribution. We also emphasize that we are interested only in proce- 
dures which result in non-self-averaged infinite- volume states (i.e., at least some correlation 
functions computed within such a state depend on J\ Recall that for the SK model, the 
very notion of such a j7-dependent infinite-volume state is unclear. 

Second, can such a Pj{q) exhibit all the essential features of the SK picture, including 
those described by the four features above? 

The answers to these two parts, given in are, respectively, yes and no. We will 
explain our construction oi pj (which is somewhat technical) and thus the "yes" answer to 
part one later in this section. Meanwhile, we mention one crucial feature of the resulting 
Pj, which plays a key role in the "no" to part two. That feature is translation-covariance; 
i.e., under the translation of J' to J'"', where J^^ = Jx+a,y+a for each J^y, pj transforms so 
that 

PJ"(o"xi = CTl, • • • = O-m) = Pjicr-xi-a = 0"l, • • ■,0-Xru-a = CTm)- (19) 

The conceptual significance of translation-covariance is that the mapping from J' to pj, 
being a natural one, should not (and in our construction does not) depend on the choice 
of an origin. It also implies the technical conclusion [^,0] that this procedure leads to a 
limiting infinite- volume overlap distribution function Pj{q), which exists for almost every 
JT" and depends measurably on J' (guaranteeing that averages of g-dependent functions can 
be taken over the couplings). To begin our answer to the second part of the question, we 
see what the translation-covariance of pj- implies about Pj. 

By translation-covariance of pj, the overlap random variable Qja has the same distri- 
bution as the random variable Qj^, where 

= hm \Al\-' Y1 ^--^x-a = Qj- (20) 

-L— >oo ' ' 
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Thus the overlap distribution function Pja = Pj for almost every J' and all a G Z"^; i.e., 
Pj is translation-invariant . 

As in the case of the translation-covariance of pj, the translation-invariance of Pj has 
the conceptual significance that a natural object like the Parisi order parameter distribution 
should not (and in our construction does not) depend on the choice of an origin. But 
it also has the very important technical (and physical) significance that Pj must be self- 
averaged because, as already noted in Section |T| (in the discussion on the number of pure 
states), a (measurable) translation- invariant function of random variables whose distribution 
is translation-ergodic is a constant almost surely, by the ergodic theorem. (We remark that 
the fact that we are dealing with a function of whose value for each J' is an entire 
distribution is not a problem, since any particular moment of that distribution is a real- 
valued function of J'.) 

This answers the second part of our question: the overlap distribution function Pj{q) = 
P{q) is independent of J7. It therefore does not exhibit non-self-averaging (property (1)), and 
can exhibit at most one of the two properties (2) and (3) discussed at the end of Section 
While property (2) (discreteness of the locations of the delta-functions which appear in 
P{q)) is not rigorously ruled out, it now seems like a highly implausible possibility, since it 
would imply that the locations (and weights) of the delta-functions (and consequently the 
values of q which correspond to no overlap value) are all independent of J'. If property (2) 
is then eliminated as a realistic possibility, then one can also rule out property (4) of the 
SK picture, i.e., ultrametricity of all of the pure state overlaps for fixed [p5|j . 

Consequently, we have proved that the standard SK picture cannot be valid in any di- 
mension and at any temperature. This result goes beyond our specific construction of the 
Gibbs state pj and overlap distribution Pj, since any infinite-volume translation-invariant 
overlap distribution function would be self-averaging. It would be quite peculiar if the over- 
lap distribution depended on the choice of origin of the coordinate system, and we therefore 
regard the property of translation-invariance for Pj (or translation-covariance for pj) as 
not specific to our particular construction. 
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Our conclusion is that nearest-neighbor (and in general realistic) spin glasses exhibit non- 
mean-field behavior, because for those systems one can construct a non-self-averaged Gibbs 
state pj whose overlap distribution Pj is self-averaged. The standard SK picture therefore 
cannot describe reahstic spin glasses at any dimension or temperature. It is important to 
note that these conclusions apply to the thermodynamics of spin glasses. What might or 
might not occur in finite volumes involves several subtle issues and will be discussed in 



Section VII. 



While the demise of the standard SK picture is interesting in itself, and has important 
consequences for our understanding of spin glasses, the methods used above and in our 
construction of pj- lead to perhaps more significant conclusions that might affect our thinking 
on not only spin glasses, but disordered — and more widely, inhomogeneous — systems at 
a deeper level. Indeed, these methods indicate a path to a new and general approach for 
studying the thermodynamics of systems with many pure states. One consequence will be 
the emergence of a replacement for the standard SK picture, a new picture which retains 
some mean-field flavor. The general formulation introduces several new concepts, among 
them replica non-independence and a new definition of non-self-averaging, and relates them 
to replica symmetry breaking, overlaps, and chaotic size dependence. The unifying theme 
is the concept of the metastate, which is introduced in the next section. Before that, we 
complete this section with a discussion of how we construct our thermodynamic state pj. 

We begin by noting that we cannot simply fix J' and take an ordinary limit (i.e., through 
a sequence of cube sizes L chosen independently of J') of the finite cube, periodic b.c. state 
p^j^p, as L ^ oo. Unlike, say, the d = 2 homogeneous Ising ferromagnet, where such a limit 
exists (and equals ^p"*" + |p^) by spin flip symmetry considerations (and the fact that p"*" 
and p~ are the only pure states [^,0]), there is no guarantee for a spin glass that there 
is a well defined limit. (In fact, if such a limit does exist for the spin glass, one can then 



prove |28| that the same limiting state is obtained through the use of antiperiodic boundary 
conditions — a feature that already seems incompatible with an SK picture.) 

It is true that one can easily prove, using compactness arguments, convergence along 
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subsequences of L's for each J'. But these subsequences should (in an SK picture) be 
jT-dependent. The inconsistency between the existence of many pure states and the exis- 
tence of a thermodynamic hmit for a sequence of finite-volume Gibbs states using coupling- 
independent boundary conditions (such as periodic) and cube sizes has serious consequences 
not only for spin glasses but also for systems in general with many competing states. It 
suggests in the present case that, if many pure states exist, such a sequence of finite- volume 
Gibbs state exhibits chaotic size dependence (CSD) and does not converge to a limit. The 
convergent (jT-dependent) subsequences would then give rise to different (non-self-averaged) 
pure states or mixed states with no way to make a (measurable) choice of a limit state for 
each J'. 

There is however a natural limit procedure which does give rise to an infinite-volume 
Gibbs state pj, while avoiding such difficulties. Here, one considers the joint distribution 
on the spins and the couplings; i.e., one considers the distribution //(JT") x p^j^^ on the periodic 



cube Al Then (again using compactness arguments) some subsequence of L's converges 
to a limiting infinite- volume joint distribution p{J',cr). From this joint distribution, pj 
results when the spin configurations are chosen conditioned on J', which is chosen from 
//(JT") in the usual way; i.e., pj is determined by the identity p{J',a) = vi^J) x pj{cr). 
The important difference with the earlier limit procedure is that this one is valid for almost 
every J', i.e., the subsequence of L's is J -independent. (The discussion so far has been 
based on mathematically rigorous arguments. At this point however, we would suggest — 
but cannot rigorously prove — that it is probably the case that using a subsequence of L's 
is not needed for convergence, because the use of a joint distribution for J and a should 
avoid CSD.) A proof that the resulting limiting distribution is indeed a Gibbs state may be 
found in We note that such joint distribution limits were considered, implicitly 



or explicitly, in Refs. |[75|-[78 



To get a clearer idea of this construction, consider the following procedure. Start with 
three cubes (labelled a, b and c), all centered at the origin, with volumes Lf, L^, and L^, with 
1 ^ La ^ Lf, ^ Lc. On the outermost box we impose periodic boundary conditions. The 
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couplings are fixed inside the intermediate box (and averaged over between the intermediate 
and largest box); and in the innermost box the overlap computation is done. The average 
over couplings between the intermediate and large boxes is equivalent to an average over 
many boundary conditions (consistent with the outer periodic b.c.) on the boundary of the 
intermediate box. 

Now let Lc ^ oo while keeping La and fixed; then let oo, while still keeping 

La fixed. This sends our "average over boundary conditions" off to infinity and results in 
an infinite- volume pj which is conditioned on all of the couplings and is therefore non-self- 
averaged. Finally, let La —>■ oo; this gives finally the overlap distribution Pj{q) between 
infinite-volume pure states appearing in the pj. 

It is important to note that any analogue of this procedure for the SK model will result 
in an infinite-spin Gibbs state, but a trivial one; i.e., it will already be self-averaged and 
therefore uninteresting. This is because fixing only finitely many couplings in the SK model 
and averaging over the remainder is equivalent to averaging over all of the couplings when 
N ^ oo. This difference between finite-dimensional and mean- field models is crucial. 

We conclude by pointing out why our construction (for the EA model) of the limiting joint 
distribution p{J', a) yields translation-covariance for pj. This is so because taking periodic 
b.c.'s on the cube really means that the couplings and spins are defined on a (discrete) 
torus of size L, with a finite-volume joint distribution invariant under torus translations. 
This implies that any (subsequence) limit joint distribution is invariant under translations 
of Z'^, which in turn implies that the infinite- volume Gibbs state pj is translation-covariant. 
In the next section, we go beyond the construction of a single limiting thermodynamic state 
by introducing the notion of metastates. 

V. CHAOTIC SIZE DEPENDENCE AND METASTATES 

In this section we will describe a new approach, introduced in Ref. [^, to studying 
inhomogeneous and other systems with many competing pure states. This approach is 
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based on an analogy to chaotic dynamical systems, and involves the replacement of the 
study of a single thermodynamic state with an ensemble of (pure or mixed) thermodynamic 
states. 

In the previous section we were forced (by chaotic size dependence) to replace a simple 
sequence of states on cubes with periodic boundary conditions with a more complicated 
sequence which involved an averaging over boundary conditions, followed by sending this 
average off to infinity. This avoids chaotic size dependence (at least for a jT-independent 
subsequence of volumes, but probably altogether). In this section, we will pursue the oppo- 
site strategy — we will forego the end run around CSD, and instead use it to gather maximal 
information about the disordered system. The price will be to abandon the usual procedure 
of constructing and studying a single infinite volume Gibbs state pj. 

The central observation behind this is that, at any (large) fixed L (and with periodic 
boundary conditions), the existence of multiple pure states should generally require an ap- 
proximate decomposition as in Eq. (p!2| ) (see also (|15|)): 



For each L, the pure states appearing with the largest weights in the sum will be those whose 
configurations within the volume of size L are best adapted to the boundary condition. 
Chaotic size dependence requires that the pure states and weights appearing within this 
decomposition vary persistently as L is increased (though it says nothing about the rate at 
which this variation occurs). 

The analogy with the chaotic orbit of a dynamical system follows from the identification 
of cube size L with time t along such an orbit. A (chaotic) dynamical system's trajectory will 
appear random if one considers the sequence of points along its orbit, but one can describe 
its long-time behavior by studying the appropriate probability measure Hdyn on state space. 
That is, one can construct a histogram at times ^1,^2, ■ ■ ■ ,tN with increasing to infinity, 
and study the fraction of times spent by the orbit in different parts of state space (in a 
continuous space this would require breaking the space up into bins). The N ^ 00 limit of 




(21) 



a 



26 



this process yields a well-defined i^dyn- 

Similarly, we consider at fixed J7 a histogram of finite volume Gibbs states 
Pj^^\pj^^\...,Pj^'^^ ^ Kj as N oo. The information contained in kj provides the 
fraction of cube sizes which the system spends in different (possibly mixed) thermodynamic 
states r. We refer to kj, which is a probability measure on thermodynamic states F at fixed 
J', as the metastate. 

To simplify notation, it will be assumed in the ensuing discussion that convergence to 
the metastate is valid without need for a subsequence of A^'s or a subsequence Li, L2, . . . of 
the cube sizes. We point out however that Kiilske has studied some models, e.g. the Curie- 
Weiss random-field model, in which choosing a sparse subsequence of sizes is necessary 
for the empirical distribution (i.e., the histogram) to converge (for almost every disorder 
configuration) to the metastate. We will not discuss these issues here, but refer the reader 
to Ref. ||79[ for details. 



Our empirical distribution approach to construction of a metastate, based on CSD for 
fixed constructs kj as the limit of a type of microcanonical ensemble in which each 
of the finite volume states pj\pj\ . . . , pj'^ has weight L^^. This limit can be understood in 
the following way: consider a (nice) function on the states, such as the correlation (cr^(Tj,)(-); 
i.e., {axO'y){r) is this correlation computed using a particular infinite-volume Gibbs distri- 
bution r, and {axCy) (p^^^) is the same correlation computed using the finite volume Gibbs 
distribution p^^^ (we suppress the J' index here, which is understood). If [-j^ denotes an 
average of a state-dependent function over the metastate (i.e., the function of each state is 
weighted using the weight of the corresponding state within the metastate), then 

L 

hm (1/L) $^(a.a,)(p«) = [M{r)l . (22) 

1=1 

Furthermore such an equation similarly holds for any other (nice) function of finitely many 
correlations (regarded function on states). 

There is another approach to constructing the metastate, due to Aizenman and Wehr 



27| , which uses the randomness of the couplings directly, in a manner similar to that of the 
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construction of in the previous section. There we studied the hmiting joint distribution 
/i(j7', 0") of the random pairs (JT, cr^^^) distributed for finite L by z^(j7') x pj^\ Here one con- 
siders instead the random pair (JT", p^j^) at finite L. We will not discuss various technicalities 
associated with this method; details can be found in Refs. [^,^,^]. We will simply note 
here that the two approaches (at the very least along common jT-independent subsequences) 
yield the same limiting metastate. 

The metastate kj contains all of the thermodynamic information about a system, in 
this case the EA spin glass with coupling realization J'. As such, it contains far more 
information than the single thermodynamic state pj generated by the construction of the 
previous section (or any other single state). In fact, it can be seen p7| , |49|j50[| that the pj 



of the previous section is the average thermodynamic state of the ensemble of states within 
the metastate nj, in the following sense: consider any spin correlation in the state pj, e.g., 
{a^i ■ ■ -Ox^pj- This equals the average (over the metastate) of the correlation function of 
the same set of spins over all thermodynamic states F of the ensemble. So if ^^/'(r) dT 
denotes (formally) the probability of appearance of the states within a region of state space 
centered on F of state-space volume dF, then 

((^^■i ■ • ■ (yx^)pj = [{(^xi ■ ■ ■ (^xJr]Kj = j {(Txi ■ ■ ■ (rx„)r nj{T) dV (23) 

and similarly for all other correlation functions. 

We see that one problem with the standard SK picture (and with other standard ther- 
modynamic treatments of systems with many competing states) is that the state p j (or any 
other single state, pure or mixed) is simply not a rich enough description of the L ^ oo 
behavior of a thermodynamic system where CSD occurs. In these approaches, one is in effect 
replacing with a single average all of the information contained in an entire distribution. 

To illustrate the nature of the metastate, we now present some simple examples. 

The first is the trivial case of a single pure phase, e.g., the paramagnetic state. Then 
Yuxvl^oo P^j^ = Pj- is a single pure state, there is no CSD, and Kj7(F) = 5(F — pj). 

In the second example we suppose that the scaling/droplet picture is correct, so that 
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only two pure states p'j and p"j exist, related by a global spin flip. Then (as in the d — 1 
homogeneous Ising ferromagnet with periodic or free b.c.'s) 



lim p-^"^ 

L— >oo 



Pj=-^(^J^-/j (24) 

and again there would be no CSD. Indeed, the analogy here is to a dynamical system with 
a simple fixed point. The metastate is simply 

Mr) = <^(r-[lp:^ + lp';]) . (25) 

However, we can introduce a slight variation of this procedure to illustrate the potential 
sensitivity of the metastate to the boundary conditions used in the limiting procedure. 
Suppose that, instead of periodic boundary conditions for each L, we use fixed boundary 
conditions, e.g., all spins are +1 on the boundary of each L'^ cube appearing in the sequence. 
This of course breaks the spin flip symmetry, and for some L's the state p'j will be preferred, 
while others will prefer p"j, depending in each case on whether the sum along the boundary 
of k'^x) p'j is (substantially) positive or negative. (There may be occasional L's where the 
preference for each state is roughly equal, but this should be a negligible fraction of L's and 
so wouldn't show up in the limiting histogram which yields the metastate.) 

So in this case we get chaotic size dependence, albeit of a trivial sort: pj^ ~ plj for 
roughly half of the L's, and p^j^ p"j for the remainder. The metastate is now 

Kj{V)^\5{T-p'j) + \5{T-p"j) . (26) 

Here the metastate is a rough analogue to the ndyn obtained from a discrete time dynamical 
system with an attractive orbit of period two. 

This is our first example in which the metastate is not simply a delta-function on ther- 
modynamic states. We call this behavior dispersal of the metastate, and it is intimately 
connected with CSD. From this and the previous example, it should be clear that dispersal 
of the metastate is quite different from the mere existence of multiple states; while the exis- 
tence of more than one state is necessary for dispersal to occur, it by no means guarantees 
it. 

29 



The above discussion leads naturally to the following possibility, first proposed in ||26| as 



a possible candidate for the EA metastate, based in turn upon earlier work in Suppose 
that the EA spin glass has many pure states in some d and at some /5, but unlike in the 
mean-field picture each volume "sees" essentially only one pair at a time. In other words, 
for every L (and once again using periodic boundary conditions), one finds that 

Pf - \p7 + \p~r (27) 

where —a refers to the global spin fiip of pure state a. In any volume, this looks very much 
like the droplet /scaling picture, but its thermodynamic behavior is considerably different: 
there are infinitely many pure states and which pair appears in any finite volume depends 
chaotically on L. Unlike the droplet /scaling picture, this new possibility exhibits CSD and 
dispersal of the metastate. In this "chaotic pairs" picture the (periodic b.c.) metastate is 
dispersed over (infinitely) many F's, of the form F = = + |pj°. 

It is interesting to note that just this type of behavior is observed for the many ground 
states of a simple highly disordered spin glass model in high dimension( see also [Q). 
(Indeed, for the EA model itself, we would expect this type of behavior to occur at T = 
if infinitely many ground states exist.) 

One can study metastates in models more complicated than those above, but still simpler 
than the EA spin glass, and a discussion of some of these (e.g., random-field Ising models, 
the highly disordered spin glass of Ref. p[, and the homogeneous XY model with random 
b.c.'s) appears in to which the interested reader is referred for details. At this point, 
however, we will proceed and use the ideas introduced in this chapter to revisit the concepts 
of replica symmetry breaking and non-self-averaging, and will introduce some new concepts 
such as replica non-independence. The idea of the metastate will enable us to relate, explain, 
and unify these concepts. We will then return to the EA model and discuss the remaining 
possibilities for its metastate, and therefore its low temperature thermodynamic structure. 
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VI. REPLICA SYMMETRY BREAKING, REPLICA NON-INDEPENDENCE, 

AND OVERLAP DISTRIBUTIONS 



We have discussed in Section the Parisi order parameter distribution Pj{q) in the 
standard SK picture, whose counterpart Pj^m{.<i) for the SK model was successful in describ- 
ing mean-field spin glass ordering. In the standard SK model Pj{q) is constructed as the 
distribution of the overlap random variable Q, which in turn is constructed according to 
Eq. (|T^), where the spin configurations a and a' are chosen from the product distribution 
Pj{cr)pj{a')] i.e., each is chosen independently from the same (thermodynamic) state pj. 

But now, given the metastate point of view discussed in the previous section, we know 
that the state pj{(j) is really the average over the metastate, in the sense described by 
Eq. (^31). Equivalently, 

pjia) = J Tia)KjiT) dT . (28) 

So each time a pair of spin configurations, say (cr^,(T^), is chosen from Pj{o'^)pj{cr'^), an 
independent F is used for each configuration. I.e., is chosen from and from F^ with 
(F^,F^) chosen from kj-(F^)kj'(F^); F^ and F^ will in general be distinct if the metastate is 
dispersed. This in turn means in essence (see (^2])) that the spin configuration is chosen 
using the distribution pj^^^ and o"^ from Pj^^\ with Li ^ L2. It seems more natural instead 
to take the two replicas from the same distribution, i.e., for a single L, and therefore from the 



same F. As Guerra has pointed out [qII], this order of operations (in which replicas are taken 
before L 00) could yield a different result than that obtained by first letting L ^ 00 to 
obtain an infinite volume state p j and then taking replicas. The noncommutativity of these 
operations will be shown to follow from a phenomenon we call replica non-independence, 
which is not the same as replica symmetry breaking, as will be seen below. But first we will 
explore the meaning of this new way of taking replicas. 

Taking replicas first (i.e., from the same L) really means, in terms of the metastate, that 
they are being taken from the same F, i.e., from F((t^)F((t^) for some F chosen from Kj{r). 
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(Without metastates, it would be difficult to assign a clear meaning to this statement.) For n 
replicas (where n can be any positive integer, or infinity) we take n uncoupled (but identical) 
Hamiltonians (and boundary conditions) in the cube L'^. We then use for finite L the 
product measure p^^^ = p~j\a^^^^) p'j\ct'^^^^) . . . p^j\a"'^^^) . The limiting joint distribution 
for {J,a^^^\a'^^^\...(T'^^^^) is then of the form u{J)pj{cr'^,a'^, . . .a"^) for some pj that 
we call the infinite volume n-replica measure. (The mathematical analysis of this limit 
procedure is essentially the same as was discussed for n = 1 in Section IV above and, with 
more detail, in ^|50|.) 

In this approach, replicas in the infinite volume limit are described by r(cr^)r(cr^) . . . 
with r distributed by kj; replicas in finite volume are taken from the same L, and kj 
describes the sampling of states as L varies. 

A crucial point, as emphasized by Guerra is that in the infinite volume replica 



measure 



Pj, the replicas need not be independent, although they of course are independent 
in the finite volume measure p^^^ ■ The replicas in infinite volume can be thought of as 
coupled through "boundary conditions at infinity". 

If this occurs, we say |]2^ that the system displays replica non-independence (RNI). The 
presence of RNI means that pj, which is a thermodynamic state for the uncoupled replica 
Hamiltonians, is not simply equal to the product of the individual Gibbs states pj{a^). In 
general, we have from the above description that 

p-jia\ a',... a") = J [T{a')T{a') . . . r(a")] kj{T) dT (29) 

This makes it clear that RNI is equivalent to dispersal of the metastate. If the metastate is 
nondispersed, its weight is concentrated entirely on a single thermodynamic state, so kj- is 
a delta function, and the RHS of Eq. ( |29| ) reduces to a simple product of Gibbs states (each 
of which is the single state on which the metastate is concentrated). Otherwise, the product 
decomposition of pj is as a mixture over kj. This also shows that RNI is equivalent to the 
non-interchangeability of the operations of taking replicas and the thermodynamic limit. 
In Ref. ||2^, these points were explained using the idea of "metacorrelations" . Just as 
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the usual correlations {(Ji^ ■■■o'jm)r are moments (in this case, of order m) characterizing 
the thermodynamic state F, metacorrelations are moments that characterize the metastate 
K. I.e., they are the averages (over the metastate) of functions g{T) on the states that are 
monomials (of order m) in the correlations (of varying orders): 

b(r)]«= [(aA,)r...(^A.)r]. , (30) 
where a a denotes ai-^ . . . cTj^. for the set A = {ii, . . . , 4}- As noted in Ref. ||2^, restriction 



to metacorrelations of order m = 1 yields pj, to m < 2 yields the two-replica measure 
Pjr(o"^, cr^), which corresponds to "integrating out" all the other replicas in py, and so on. 
The measure pj therefore not only contains information about arbitrarily many replicas, 
but since it determines all the metacorrelations, it also contains all information about the 
metastate kj. 

Replica symmetry breaking (RSB) occurs when individual thermodynamic states F (cho- 
sen from n j) are mixtures of multiple pure states, so that even, when restricted to a single 
r, replicas can come from different pure states, in the spirit of the Parisi ansatz. This defini- 
tion allows for what we call trivial RSB (e.g., in a two-state picture), but corresponds to the 
more familiar meaning when many pure states are present in F. The presence of RSB means 
that when one decomposes each mixed F in Eq. (^) into pure states, then the permutation 
symmetry between different replicas is lost in each of the products where a pure state is 
chosen for each replica. It follows that RSB and RNI are distinct phenomena, and either 
can occur without the other. 

Although we have a new way of constructing a replica measure, we can still take overlaps 
in the usual way, i.e., according to Eq. ([16|). The distribution of an overlap Q, though, 
depends on how a and a' are chosen. Because of the possibility of RNI, we no longer take 
overlaps (between one or more pairs of replicas) from the product measure Pj{o'^)pj{<y'^) ■ ■ ■, 
but instead from the more suitable replica measure py. Because of this, the nature of the 
overlaps changes. For example, the distribution of a single overlap Q is no longer the Pj{q) 
obtained from Pj{o')pj{cr') but rather is J Pr{q)K,j{T)dr, where Pr{(l) denotes the overlap 
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distribution obtained from r(o")r(cr'). When nj is dispersed, Pr may or may not depend on 
the r chosen from nj. (It does not in the chaotic pairs picture but does in the nonstandard 
SK picture discussed below.) Information on this dependence is contained in the overall 
"overlap structure" , by which we mean the joint distribution of all overlaps Q^^ betwen all 
pairs of replicas (cr^cr-^) from pj. This (possible) dependence on F is significant because, 
as in our analysis above of the standard SK picture, the overlap structure still does not 
depend on J', by essentially the same arguments using translation-invariance of the overlaps 
and translation-ergodicity of the coupling distribution ui^J). More specifically, regarding Pr 
as random because of its dependence on F for fixed J , the probability of appearance of a 
particular set of weights and corresponding locations of the overlap delta-functions will not 
depend on J . (Here, we are describing the situation, discussed at length in the next section 
of the paper, in which Pp, for each F, has an SK type form.) 

In realistic systems, thermodynamic state observables can depend on the bulk couplings 
and/or on the couplings at infinity. Thus we observe that there are two distinct types of 
dependence: (i) on J , and (ii) on the state F within the metastate k, for fixed J . We have 
seen that replica overlaps cannot have the first type of dependence, but can in principle have 
the second kind. In that case, if one examines the same (finite) volume for two different 
coupling realizations, it could happen that two different sets of weights and overlap locations 
are seen (in the approximate sense corresponding to the fact that we're restricted here to 
finite volumes, so that, e.g., the finite volume overlap distribution P^^^ is not a sum of exact 
delta functions). It is logically possible that in such a case, fiuctuations in P^j^ persist 
for arbitrarily large L. From our previous discussions, however, it would be incorrect to 
conclude that there is an infinite volume overlap distribution that is non-self-averaging (i.e., 
that depends on J\ Rather, it would imply that the limit limi^oo-Pj'^ does not exist; i.e., 
that Pj^^ exhibits chaotic size dependence ||8^ . 

Our conclusion is that if overlap fiuctuations (due to coupling dependence) don't vanish 
as L — ^> oo [Q, this does not mean that the standard SK picture of overlap non-self-averaging 
holds; rather, it is a signal that the second kind of dependence holds for infinite volume. 
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With the new approach outhned above, a replacement for the standard SK picture sug- 
gests itself. This replacement at first may seem very unusual and different from previous 
understandings of thermodynamic spin glass structure, but it falls out naturally from the 
ideas presented in this and the previous section. In the following section we ask, how can at 
least some of the familiar characteristics of the Parisi version of spin glass ordering be re- 
tained in realistic spin glasses? We will see that the "maximal" mean-field picture allowed, 
given our new understanding of metastates and their consequences, has an intricate and 
novel thermodynamic structure. 



VII. THE NONSTANDARD SK PICTURE 

We saw in Section |^ that the familiar thermodynamic picture usually associated with 
the Parisi ansatz applied to the EA model, which we called the standard SK picture, could 
not be valid in any dimension and at any temperature. Any thermodynamic theory of 
realistic spin glasses will differ considerably from this picture. The question then is whether 
and how any aspects of mean-field behavior can survive in such a theory. We now address 
this question. 

We begin by asking what a maximal mean-field picture would look like in finite volume. 
There have been a number of numerical simulations (e.g., [^,^,^) which appear to see 



a Parisi-like structure of finite- volume states, i.e., the appearance of several states with 
nonnegligible weight, several (approximate) delta-function overlaps whose positions depend 
on coupling realization, and a Parisi-like P{q) (i.e., delta-functions at -^Qea connected by 



a continuous part) after averaging over the couplings. (See, however, |^3[ for a criticism of 
P2|| .) We will not attempt to resolve controversies associated with these or other simulations, 
nor will we speculate whether, if correct, these results persist for larger volumes. Rather, 
we ask if such results should hold for arbitrarily large volumes, what does that imply about 
the thermodynamics of spin glasses, given that the usual thermodynamic extrapolation of 
these finite- volume results (i.e., the standard SK picture) is incorrect? 
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We will see that the metastate approach allows us to construct such a thermodynamic 
scenario, which we call the nonstandard SK picture. This picture, or one closely related to it, 
must describe the thermodynamics of realistic spin glasses if the above finite-volume picture 
is correct. That is, the nonstandard SK picture allows for properties (1) - (4) appearing 
at the end of Section |T| (or more precisely, finite volume versions of these properties) to 
hold in any fixed finite volume (with, e.g., periodic boundary conditions). It is therefore a 
maximal mean-field picture, as promised at the end of the previous section. However, the 
thermodynamics to which it gives rise is novel and unconventional. It displays RSB and 
RNI (equivalently, CSD) and a type of non-self-averaging, suitably redefined (as described 
in the previous section). It does not have the features commonly thought of as associated 
with the Parisi ansatz, e.g., ultrametricity of all of the pure states [0,0, but displays some 
of its properties in a more limited fashion. 

As a starting point, then, we require that in any (large) finite volume, the Gibbs state 
is an approximate decomposition over many pure states: 

pf{a)^J2^^''p'}{a), (31) 

a 

where a few states dominate the sum. From the metastate point of view, this implies that 
each r (chosen from nj) is a mixed state with a nontrivial decomposition into pure states, 
namely 

T = J2WrPji^), (32) 



and this decomposition is discrete but with many nonzero weights 

In order that this scenario correspond to the usual expectations of the Parisi/SK picture 
in finite volumes (and at fixed J'), we require that the fixed-F overlap distribution 

Pr{q) = Y.^rWMQ-Q''') (33) 

a, 7 

display the form consistent with property (2) listed at the end of Section |T|, that is, a 
countable sum of many delta-functions. (Note that the occurrence of many (distinct) ga-^'s 
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is an additional requirement, and does not follow automatically from Eq. ([3^).) The metas- 
tate must be an ensemble of many such F's (in fact, a continuum of them, as we explain 
below), each of which yields a pair of delta-functions at ^Qea, but with the locations of the 
remaining delta-functions being F-dependent. We further require that the locations of the 
delta- functions within a specific Pr{(l) be ultrametric. 

The above requirements are consistent with properties (1) - (4) of Section |T| holding 
for any finite volume, including (conventional) non-self-averaging for arbitrarily large L. 
However, instead of the straightforward extrapolation to infinite volumes characteristic of 
the standard SK picture, the thermodynamic properties of this nonstandard SK picture are 
considerably different. We now discuss what these properties are. 

The crucial conceptual point is that the translation-covariance of the metastate k, j still 
requires that the resulting ensemble of overlap distributions is independent of J^. The 
metastate in this picture must be an ensemble of many F's , with a single F appearing in 
any fixed cube L'^ (with, e.g., periodic boundary conditions). The dependence on F (as F 
varies within the metastate ensemble) is the new sort of non-self-averaging discussed at the 
end of the previous section. It is clear then that this picture must have both nontrivial RSB 
(because each F is a sum over many pure states), and CSD (and RNI) since the metastate 
is dispersed. 

Finally, we require that the (averaged) Parisi order parameter P{q) have the usual form, 
that is, two delta-functions at ±qEA, connected by a continuous component with nonzero 
weight everywhere in between; however, the averaging must now be done over the states F 
within the metastate kj, all at fixed JT", rather than over J' itself: 



In order for this requirement to be valid along with discreteness of the individual Pr's, it 
must be that there is a continuum of F's in the metastate ensemble. So we have replaced 
dependence on coupling realization J' with dependence on the state F within the metastate 
for fixed J . 




(34) 
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We see that the nonstandard SK picture differs from the usual mean-field picture in sev- 
eral important respects. One is the lack of dependence of overlap distributions on JT, and the 
replacement of the usual sort of non-self-averaging with the concept of dependence on states 
within the metastate. Another important difference is that, in the nonstandard SK picture, 
a continuum of pure states and their overlaps must be present; therefore, ultrametricity 
would not hold in general among any three pure states chosen at fixed J', unlike in the stan- 
dard SK picture (see, for example, |^|57| ). (The argument supporting this conclusion is 



presented in Ref. [^.) Rather, the pure states at fixed J' are split up into (a continuum 
of) families, where each family consists of those pure states occuring in the decomposition 
of a particular F, and only within each such family would ultrametricity hold. 

We have presented the nonstandard SK picture as a replacement for the more standard 
mean-field picture; if realistic spin glasses display any mean-field features, something like it 
must occur. However, this leaves open the question of what actually happens in realistic 
spin glasses. In particular, does the nonstandard SK picture actually occur? It turns out to 
have an important covariance property which may provide a clue. 

For specificity, consider the EA model with a (mean zero, variance one) Gaussian coupling 
distribution. Suppose that we change a finite number of couplings. The metastate kj-(F), in 



addition to translation-covariance, is also covariant with respect to this change |^; that is, 
the ensemble transforms (as would any probability measure) under a change of variables, F 
F'. Here, F' is the thermodynamic state with correlations {o'A)r' = (o"Ae~^^^)r/(e~^^^)r, 
where AH is the change in the Hamiltonian. Under this change of variables, pure states 
remain pure and their overlaps don't change. However, the weights which appear in Eq. (|33D 
will in general change. Nevertheless, the overall overlap structure (i.e., the probability of 
appearance of a given set of weights and overlap locations) must remain invariant. 

We propose this covariance property under coupling changes as an appropriate ana- 
logue to that of of dynamical systems having a probability measure invariant under the 
dynamics. Our reasoning is as follows. Suppose we consider free b.c.'s. Changing from a 
cube of size L to one of size L + 1 corresponds to taking a certain layer of couplings and 
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changing them from zero to nonzero values. Having already made an analogy between L 
and the time t for the dynamical system, it seems appropriate to extend it to one between 
dynamical invariance {t —>■ t + 1) and coupling covariance (JT" —>■ J' + AjT"). The analogy is 
even clearer if we consider increasing volumes not by a whole layer at a time but by a single 
site at a time. Exploitation of this covariance property could result in a new type of cavity 
method [p9i|66i|67| for studying the properties of realistic spin glass models. 

In the nonstandard SK picture, there seems every reason to expect nontrivial dependence 
of, e.g., {e~^'^^)j on the many a's appearing for each T. Thus, under changes of finitely 
many couplings, each Pr would be changed to a Pp' with the same g^-y's but with different 
weights. Nevertheless, by the translation- invariance/ergodicity argument mentioned earlier 
in this section, the distribution of the Pr's (as F varies over the metastate) in fact does not 
depend on J' and hence is unchanged hj J' ^ J' + AJ'. 

Thus the above covariance property under changes of couplings places a large number 
of constraints on the distribution of the Pp's that can arise in the nonstandard SK picture. 
We wonder whether all these constraints (which do not arise either in the droplet / scaling or 
in the chaotic pairs pictures) can actually be satisfied. Clearly, more study of this issue is 
needed. 



VIII. CONCLUSIONS 

We have shown that the traditional picture of spin glass thermodynamics, based on the 
Parisi ansatz as applied to finite-dimensional models, cannot hold for realistic spin glasses 
in any dimension and at any temperature. This standard SK picture is a natural and 
straightforward extrapolation to infinite volumes of the main features of spin glass ordering 
uncovered by Parisi and others for the SK model. It assumes a single infinite volume overlap 
distribution function Pj{q) which is non-self-averaging, i.e., dependent on J'. This picture 
proposes that the pure states are chosen independently from some mixed (and, of course, 
non-self-averaged) thermodynamic state pj with a decomposition of the form of Eq. (|T3[) 
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and that the resulting Pj{q) will consist of (many) discrete delta-functions lying between 
a pair at ^Qea- The locations of the delta-functions (except for the pair at ^Qea) and 
their weights depend on the coupling realization J', but for any fixed their locations 
are ultrametric. When averaged over the (uncountably many) coupling realizations chosen 



from the coupling distribution, the order parameter distribution P{q) = Pj{q) shows the 
characteristic form of a continuous component connecting the delta-functions at ^Qea, and 
nonzero everywhere in between (at least for < T < Tc). 

We have shown, however, that this picture can never hold: any Pj{q) with the weak (and 
physically reasonable) property of translation-invariance must be self-averaging, due to the 



underlying translation-ergodicity of the coupling distribution. In Section |^ we presented an 
explicit construction of such a non-self-averaged thermodynamic state pj, which obeyed the 
physically important requirement of translation-covariance, and whose overlap distribution 
function was thus translation- invariant. We know of no other (natural) construction of a 
thermodynamic state for the EA model (which is measurable with respect to the disorder 
configuration), in the event that the spin glass does indeed possess many states (in which case 
chaotic size dependence must be taken into account) at some dimension and temperature. 

Although we presented these results (and much of our other discussion on spin glasses) in 
the context of the EA model, we stress that they apply quite generally to most realistic spin 
glass models, because they depend only on general properties such as translation-invariance 
of the overlap function and translation-ergodicity of the underlying disorder distribution. 

These results lead, however, to a new approach to the thermodynamics of systems with 
many competing states that is far more general than considerations of spin glasses alone 
might indicate. The failure of the standard SK picture arises from the fact that if many pure 
states do exist for a particular system (at some dimension and temperature), then chaotic size 
dependence generally follows and it becomes unreasonable to describe the thermodynamics 
through a single state — even though this state may be a mixture of infinitely many pure 
states — as in the standard approach. As an alternative, and based on the example of a 
chaotic dynamical system, we describe the thermodynamics through an ensemble of states 
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(which may themselves be mixtures of pure states) that we call the metastate. Within that 
approach, the idea of replicas (whose correlations determine the metacorrelations of the 
metastate) becomes natural and formerly mysterious concepts — such as replica symmetry 
breaking — become clear. Further, the connections between these and newer concepts such 
as replica non-independence and dispersal of the metastate can be easily uncovered. 

A crucial issue is the replacement of the old concept of non-self-averaging (as dependence 
on the bulk coupling realization) with a new version of dependence on boundary conditions 
at infinity. This allows for the possibility that moments of q (for example) as computed 
through the distribution Pi^\q) in any finite volume can depend on J' for arbitrarily large 
L — even though Pj{q) itself is independent of J . Within the context of the nonstandard 
SK model, we replace the idea of dependence on J with dependence on the state F within 
the metastate for fixed J . This new notion corresponds, roughly speaking, to dependence 
on couplings at infinity (which yield a kind of annealed boundary condition at infinity) or 
to dependence on L, all for fixed J . 

Applying these results to the EA model, we find that several scenarios for the metastate 
remain as logical possibilities in various dimensions and temperatures. One of course is the 
trivial paramagnetic phase. Another is the scaling/ droplet model. Two other possibilities, 
mentioned in Ref. |2^, involve states F consisting of a continuum of pure states; in one of 



these scenarios the metastate is dispersed and in the other it isn't, although both exhibit 
replica symmetry breaking. However, we see no evidence that either of these apply to 
realistic spin glasses, and so do not discuss them further here. 



An intriguing new possibility, also discussed in Ref. p6[, is the chaotic pairs picture, 
which is different from both droplet /scaling and mean- field pictures. This picture follows 
naturally from our earlier discussion on the metastate; it has infinitely many pure states, but 
with weights so mismatched in any finite volume (with, say, periodic boundary conditions) 
that only a pair of pure states (related by a global spin flip) appear. So in finite volumes this 
picture resembles droplet/scaling, but it has a very different thermodynamics; in particular, 
there are infinitely many pure state pairs and which of these appears in a given volume 
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depends chaotically on L. It is interesting to note that this scenario actually arises in high 
dimensions in a highly disordered ground state model of spin glasses [§. 

Finally, we discussed a maximal mean-field picture called the nonstandard SK picture. 
This picture has features which resemble some of the familiar aspects of Parisi-type spin 
glass ordering in finite volume — and is consistent with various numerical simulations which 
claim to see this type of ordering — but has an unfamiliar thermodynamic structure and 
does not correspond to the usual picture presented in the literature. In particular, it does not 
possess nontrivial ultrametricity of all of the pure states corresponding to a fixed coupling 
realization J\ indeed, one of our results is that such ultrametricity cannot occur in any 
reasonable spin glass picture. It also does not possess non-self-averaging (in the sense of 
JT"- dependence) of thermodynamic quantities related to the order parameter, such as the 
overlap distribution function. 

Nevertheless, the features of non- self- averaging and ultrametricity could appear in any 
finite volume if this picture should hold. This leads to a further conclusion, namely, that 
for systems with quenched disorder (and for inhomogeneous systems in general) with many 
competing thermodynamic states, properties which persist in large finite volumes cannot be 
straightforwardly extrapolated to a description of the thermodynamics . In these cases, the 
metastate approach is indispensible for sorting out the thermodynamics. 

In any case, we have serious reservations about the viability of the nonstandard SK 
picture. Although we cannot at this point rule it out on purely logical grounds, it requires 
an enormous number of constraints to be simultaneously satisfied. 

Further work is needed to determine which of these remaining pictures does hold for 
real spin glasses. Work is also needed to study the connections between the approach 
presented in this paper to systems in equilibrium and the dynamical behavior of systems out 
of equilibrium. Such investigations are currently in progress. We conclude by again pointing 
out that although we have concentrated in this paper on spin glasses, the phenomenon of 
thermodynamic chaos and the metastate approach to its analysis are potentially applicable 
to any thermodynamic system (disordered or not, inhomogeneous or not) in which there are 
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many competing pure states and the finite volume boundary conditions (or fields) are not 
(or cannot be) carefully chosen to favor one (or a very few) of them. 
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